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[57] ABSTRACT 

Image processing method and apparatus Nvherein candi- 
date points are first selected in a log-polar image do- 
main. The points may be selected by edge detection, 
thresholding, or any method suitable for identifying 
image points which are likely to lie on some feature of 
interest For every candidate point there is drawn, also 
in the log-polar domain, a mirror image of a curve that 
represents the log-polar image of a straight line. There 
is accumulated a log-polar domain histogram of "hits" 
from the drawing process. Finally, a peak bin is se- 
lected. The position of the peak bin corresponds to the 
position of the recognized line. 
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(PEG) has been successfully applied in a number of 

METHOD AND MEANS FOR RECOGNIZING imaging applications. 

PATTERNS REPRESENTED IN LOGARITHMIC In an. article entitled "Exponential Sensor Array Oe- 

POLAR COORDINATES ometry and Simulation** presented at a conference on 

5 Digital and Optical Shape Representation and Pattern 

FIELD OF THE INVENTION Recognition, Proceedings of SPIE. Apr. 4-6, 1988, the 

A portion of the disclosure of this patent document P'*^^< ^ ^"^^^ ^^^"^^ ^*=Jf 

contTs material which is subject to Copyright protec J^^ exponential sensor geometry and ordinary 

wi*uui« ixioLCiioi YTui J , , .^^ Cartesian miage sensor geometry The conversion be- 

tion The c^pyi^ht owner has no o^^^^ ,0 ^^^^J^ ^^^^ image coordinates and the 

smide reproduction by anyone of the pa ent documa^^^ ^^^^ coordinate of polar exponential sensor 

or the pat«it ^sclosure as It appears m the Patent and ^ f^^^^ . hereinafter, and 

Trademark Office patent file or records, but otherwise >^ represented hiVuch coordinites is termed -log- 

reserves aU copynght rights whatsoever. * imagery". 

This invention relates generally to miage processoi^ 15 ^^^espite the great utility of the Hough transform and 

and, m particular, to miage processmg method and j^^wn ^^^ants thereof for image processing applica- 

apparatusqp^ratmg on miage data whic^ ^^^^ ^^^^^^ disadvantages are known to exist One 

m loganthmic polar coordmates. significant disadvantage relates to an inability to apply 

BACKGROUND OF THE INVENTION . the Hough transform locally, such as directly at a plane 

_ „ , , ; .J , , J «• of image sensors. Instead, electronic buses and other 

The Hough transform IS a widely known and effec- ^^^^^^ ^^^^ 

tive method for detectmg and measurmg extended ^^^^ , ^ ^ processing electronics for Hough 

Straight lines in images m the presence of noise and ^^^f^^ processing. 

discontmuities. Another disadvantage of the Hough transform is that 

In U.S. Pat. No. 3.069.654, issued Dec. 18, 1962, 25 the Hough transform coordinate system is totally difFcr- 
"Method and Means for Recogmzmg Complex Pat- ^ coordinate system. Thus, there must 
terns**. P.V.C. Hough discloses method and apparatus ^ computational conversion between the two coordi- 
for dividing a viewed image representation mto suffi- ^^^^ gy^^^^ Furthermore, the inhercnUy discrete sam- 
ciently smaU sectors such that a complex pattern u ^^^^ properties of the image sensor transform to corn- 
divided into substantially straight line segments. Each plicated digitization errors in the Hough representation, 
straight line segment is detected and transformed mto ^ ^ ^^ject of the invention to provide a gco- 
slope-intercept data for detecting the presence of pat- ^^^^^ coordinate representation which is identical for 
terns within the image. iinage and Hough domains, and a simplified 
In Duda and Hart*s classical formulation of the method for executing a Hough transfonn within this 
Hough transform for Cartesian image domains ("Use of unified coordinate system, 

the Hough Transform to Detect Lines and Curves in ^ another object of the invention to provide for a 

Pictures**, Communications of the ACM, pp. 11-15, simplification of image processing apparatus and 

January, 1972) a straight line (Li in FIG la) is trans- method over conventional Hough transform-related 
formed into a point (H(Li) in FIG. lb) in a space whose ^ techniques. 

coordinates are the orientation and position parameters jt jj another object of the invention to provide appa- 

of the line. A point in the Cartesian domain (P2 in FIG. j^tus and method for executing a log-Hough transform 

la) is transformed into a Hough domain sine curve technique. 

(H(P2) in FIG. Ifr) whose constituent points correspond it is another object of the invention to provide a 
to the orientation-position combinations consistent with log-Hough transform method and apparatus that is ame- 
all possible lines through the Cartesian domain point. A nabig to integrated circuit fabrication techniques for 
set of Cartesian domain points transforms to a set of "in-place" local image processing that eliminates a re- 
Hough domain sine curves, which intersect at a single quirement for buses to export data away from image 
point if the Cartesian points are coUinear. sensors to an external Hough domain. 

Points Pa. P4, and P5 in FIG. la are colHnear; their cnavr * pv ot^ xhp iTJVPMTTnM 

corresponding sine curves m FIG. 16 intersect at the SUMMARY OF THE INVENTION 

poinx labelled H(P3, P4, Ps)- Thus, a duality relates The foregoing problems are overcome and the ob- 

Cartesian domain points to Hough domain sine curves, jects of the invention are realized by method and appa- 

and Hough domain points to Cartesian domain straight ratus that modifies the Hough transform for application 

lines. The Cartesian and Hough domains are distinct to log-polar coordinate imagery. Log-polar mapping 

entities with distance geometries. The Hough domain has been found to unify the geometry of the image 

serves as a two dimensional histogram which sorts can- domain and the Hough domain, thus simplifying the 

didate points based on the families of lines with which Hough algorithm. Histogram bins are superimposed 

they are consistent, and statistically pools collinear Car- directly on the image domain, facilitating immediate 
tesian points by tallying coincident loci of their corre- 60 construction of inferred lines. The use of the invention 

sponding sine curves. Maximal peaJcs correspond to the also beneficially eliminates slope quantization asymme- 

recognized lines. tries. The teaching of the invention shows that the 

In U.S. Pat No. 4,267,573» issued May 12, 1981, Hough transform is more naturally matched to log- 

"Image Processing System", G. Chaikin and the present polar mapped imagery than to conventional Cartesian 
inventor disclose an image processing system having 65 imagery. Thus, the use of the methods and apparatus of 

imaging sensors arranged in a polar exponential array the invention provides for greater image processing 

geometry. This sensor geometry, also known as log performance to be achieved with less complex image 

spiral, conformal logarithmic and polar exponential grid processing hardware and algorithms. 
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In accordance with the invention, for the log-Hough FIG. Id illustrates, in accordance with the teaching 

tnnsfonn the corresponding sequence of steps takes of the invention, a Log-Hough Domain; 

place entirely in the log-polar image donuun. FIG. 2 illustrates a Log-Polar sensor array and a 

In accordance with the invention candidate points are corresponding computational space of the prior art; 

fiist selected in the log-polar image domain. The points 5 pjQ 3 graphically illustrates a method of the inven- 

may be selected by edge detection, thresholding, or any ^Jq^ recognizing a line by employing a Log-Hough 

other conventional method for identifying image points transform; 

which are likely to Ue on some feature of interest For 4 juustrates a Cartesian interpretation of a Log- 

every candidate point there is drawn, also in the log- p^j^ ^^^^ construction; 

polBT domain, a mirror image of a curve that represents ^ ^ niustrates a Log-Polar image that is input to 

the log-pohir image of a straight hne. There is accumu- Log.Hough transform circuitry of FIG. 6; 

Uted a log-polar domain histogram of hits from the ^ ^ ^^^^^^^ ^^^^^^ 

drawmg process. Fmally, a peak bm is selected. The _ , . r ct/^ ^ • * *t> * r 

* *1 -I, u .^.. r™V^o «f form accumulator of FIG. 6 in response to the input of 

position of the peak bm corresponds to the position of _ r t- 

the recognized line. FIG. 5g; 

In accordance with a presently preferred hardware FIG. 6 Ulustrates in block diagram form one embodi- 

embodimcnt constructed in accordance with the inven- nient of cu-cuitry, constructed in accordance with the 

tion image data is presented and stored in log-polar invention, for implementing the Log-Hough transfor- 

fonnat The stored dau is first processed by a local pixel mation; 

neighborhood operator or filter, such as a 3 X 3 filter, to ^" FIG. 7fl is a flow chart that illustrates the method of 

identify high contrast points or pixels within the image. the invention; 

A differential movement Look Up Table (LUT) stores FIG. is a flow chart illustrating in greater detail 

the shape of a construction curve, that is the mirror the step of Constructing Features of Interest of FIG. la; 
image of the log-polar representation of a straight line. ^ and 

An output of the 3 X 3 filter is a value that indicates the FIG. 9a illustrates an original image presented in the 

strength of an edge at the center of the 3 X 3 area. If the Cartesian domain. FIG. Hb illustrates the image after a 

edge strength exceeds a programmable threshold, a transformation to the Log-polar domain and, in accor- 

transfonn construction process is initiated. An Edge jja^ce with the invention, FIG. 8c illustrates the image 
Scan Address Generator generates addresses for read- 3^ transformed to the Log-Hough domain, 
ing out the input Array while the array data is provided 

to serial shift registers for appUcation to the edge detec- DETAILED DESCRIPTION OF A PREFERRED 

tor, A Threshold Register stores a predetermined EMBODIMENT OF THE INVENTION 

threshold value for input to an Edge Level Comparator. ^^^^^^ apparatus of the invention may be 

Another input to the Comparator is the output of the 35 j^yed for detecting straight lines and certain aige- 

edge detector. The Comparator compares the nvo in- ^^^^ ^^^^ ^ ^^^^ ^^^^^ ^^^^ ^ 

puts to determme When ne precetermmea cage mr^n- ^^^^^ niulti-dimensional data. Other examples of multi- 
old value is exceeded and causes a control logic block to -ij. ij *r 
initiate an operation wherein a Hough transform log- dimensional data mclude any set of measurements in 
line is writt«i to an Output Memory Array wherein 40 which observations are indexed by more than one van- 
intersections are accumulated. The Hough transform ^^e. For example, m an experiment whose outcome is a 
process increments the contents of each pixel in an one dimensional value, the experimental environment 
Output Memory Array. The address from the Edge may be set up to control two or more vanables. A sys- 
Scan Address Generator is employed to load, when the tcmatic relationship between the outcome of the cxperi- 
Comparator indicates the presence of a pixel having a 45 ment and the combination of control variables is an 
value that exceeds the threshold value, a U address example of a pattern or feature of interest, 
counter and a V address counter. The U and V address By example, the invention detects extended features 
counters generate addresses for the Output Memory of interest in image data, the features including straight 
Array during the transform process. A Transform Path and curved lines, circles through the origin of a loga- 
Counter is initialized to zero and counts up, 1 count per 50 rithmic polar coordinate system and parabolas or hy- 
clock cycle, until a required number of transform path perbolas whose focuses arc at the origin of the logarith- 
pomU are coimted. If the U-V address is within the ^^5, pQj^r coordinate system. Thus, although the disclo- 
Output Memory Array address space the correspond- sy^e presented below is given in the context of image 
ing content of the Array is read, incremented by 1 and processing appUcations those versed in the art wUl real- 
written back to the same location within the Output 55 that the teaching of the invention is applicable in 
Memory Array. TOs operation corresponds to accum ^^^^ multidimensional dau which can be 
lating values m bins of a lustogram. At the completion ^ logarithmic polar coordinates, 
of the process the bm havmg the highest value is associ- ^ ^ uiustmXed in FIG, Ic in a log-Hough transform 
atcd with a position of a feature of mtcrest in the unage. . . . r • * • r v * 
^ 60 **^J^^ of recogmtion arc Cartesian straight hnes, but 

BRIEF DESCRIPTION OF THE DRAWING viewed in log-polar coordinates (LI in FIG. Ic). As is 

The above set forth and other features of the inven- ^^ov^^ ^^ovi the log-Hough dualities between curves 

tion will be made more apparent in the ensuing Detailed Pomis in FIGS. Ic and Id are geometnc mirror 

Description of the Invention when read in conjunction imag«s of each other. That is, the log-Hough domain is 

with the attached Drawing, wherein: 63 geometrically identical to the log-polar image domain. 

FIGS, la-lc illusUate three prior art image transform As a prelhninary step there is first developed below the 

domains, including the Cartesian (FIG. la), Hough relevant geometry of- the log-polar mapping of Carte- 

(FIG. 1^) and Log-Polar (FIG. Ic); sian straight lines below. 
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FIG. Xc, point PI is the apex of line LI; conversely, LI 
LCX3-P0LAR IMAGE OF STRAIGHT LINES ^ i^al line of point PI. 
AND CIRCLES 

, . - ■ , LOG-HOUGH TRANSFORM OF THE 

FIG. 2 illustrates the geometry of the log-polar map- INVENTION 
pins, which can be expressed as a coordinate change ^ 

from (x y) to (u.v) where The classical Hough transform recognizes Imes by 

histogranrnung parameter combinations consistent with 
iu,v)='ilog^sqn(x*X'^y'y)\arctaniy/x)) (1) isolated local observations of candidate points. The 

essential sequence of steps for the Cartesian Hough 
The name "log-polar" derives from the observation that 10 transform may be expressed as follows, 
"u" in equation (1) is log(r) and "v" is theta in tradi- 0) Present the image in Cartesian Coordinates, 
tional polar coordinates. Expressing equation (1) as a 1) Select candidate points m the Cartesian image 
conformal mapping. domain (e.g. by edge detection). ^ „ 

2) For each candidate pomt, draw the Hough domain 
w^Logiz), (w=if+fr, *=x+<f) (2) 15 sine curve which corresponds to all lines through that 

point. 

clarifies the expression of numerous interesting geomet- 3) Accumulate a Hough domain histogram of *'hits" 
ric properties useful in, for example, robot vision. It from the drawing process. 

should be noted that rotation by angle phi in the Carte- 4) Select the peak bins; their Hough domain coordi- 
sian domain corresponds to adding phi to v in the log- 20 nates are the polar coordinates of the apexes of the 
polar domain, and zoom in the Cartesian domain corre- recognized lines. 

sponds to adding the log of the zoom factor to u. That 5) Construct the recognized hnes m the image domam 
il by converting the Hough domam points from polar to 

Cartesian Coordinates, and drawing the lines through 
{tog(kr), tketa+phi')={iog(k)+fogiF),v+phO 0) 25 them which are perpendicular to the lines from them to 

the origin. 

The Cartesian straight line is the object of recognition In accordance with the invention, for the log-Hough 
by the Hough transform. The polar coordinate equation transform the corresponding sequence of steps takes 
of a straight line with slope tan(phi) and closest distance place entirely in the log-polar image domain, 
from the origin, rho, (as in FIG. Ifl) is 30 O Present the image in log-polar coordinates. 

1') Select candidate points in the log-polar image 
r^rho*ae(theta~phi), o<theta~phi<pi {<) domain. The points may be selected by edge detection. 

2') For every candidate point there is drawn, also in 
Thus, from the discussion following equation (1) above the log-polar domain, a mirror image of the point's 
the log-polar equation is 35 apical log-line, 

3') There is accumulated a log-polar domain histo- 
tt=/cg(Mo)-/(ig(5/fl(v-/iA0) (3) gram of hits from the drawing process of step 2*. 

4') Next the peak bins are selected. The position of 
It is noted that scaling rho and rotating theU simply the peak bins corresponds to the apexes of the recog- 
translates this curve in the log-polar domain as expected 40 nized log-lines. 

from equation (3). 5') Construct the recognized log-lines whose apexes 

In accordance with the invention, this translation is are the peak bins, 
important in the construction of the log-Hough trans- As can be realized the log-Hough transformation 
form. The orientation and scale of this curve are invari- taught by the invention is an *'in-place" algorithm in the 
ant under all values of rho and phi. Hereinafter this 45 log-polar domain, with the obvious caveat that histo- 
curve, the log-polar image of a Cartesian straight line, is gram data is to be distinguished from the image data, 
referred to as a log-line for brevity. FIG. Id depicts this separation by rising a copy of the 

As can be seen in FIG. tc the log-line LI is concave log-polar domain of FIG. la; although the domains are 
to the right, and asymptotic to actually superimposed. That is. H(L1) is identical to PI. 

50 This provides for improvement in efficiency in step 5') 
f-pki=Oandv~phi=^pi (6) in comparison to step 5 of the conventional Hough 

transform. 

The curvature of the log-line, sin(v— phi), is maxi- FIG. 3 illustrates the execution of steps 1' through 5' 
mum at its leftmost point. as set forth above. Pomts PI and P2 represent two can- 

55 didate points selected in step 1'. Curves LI and L2 are 
u^hg^rho), v=pi/i'i'phL O the corresponding mirror images of their apical log- 

lines drawn in step 2'. The histogram built from this 
which is denoted as the apex of the log-line. Point PI in construction in step 3' has a peak, detected by step 4', at 
FIG. tc indicates the apex of log-line LI. The apex the intersection P3 of curves LI and L2. The point P3 
corresponds to the closest approach of the original 60 serves as the apex of log-line L3 which is the unique 
Cartesian line to the origin, whose polar coordinates are log-line through points PI and P2, constructed in step 
in fact the Hough coordinates of the line in the classical 5'. 

Cartesian formulation. Continuing in this vein of tcnni- The validity of the log-Hough transform can be de- 
nology the apex of a Cartesian line is referred to as the rived from the Cartesian interpretation of the log-polar 
closest point to the origin and, conversely, an apical line 65 domain construction, as illustrated in FIG. 4. Curves LI 
of a point is defined herein as the line whose apex it is. and L2 in FIG. 3 correspond to circles CI and C2 in 
Similarly, in the log-polar domain the apical log-line of FIG. 4. That is, the mirror image of a log-line is the 
a point is the log-line whose apex the point is. That is, in log-polar map of a circle whose diameter joins the ori- 
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gin and the apex of the corresponding Cartesian line. 1989. Log*po]ar mapping of conventional video images 

This can be proved by reversing the sign and offsetting can also be implemented at typical frame rates via pixel 

to the apex (mirroring) in equation (5)» yielding address look-up tables and accumulator memories. Log- 
polar mapping on frame buffer contents may also be 

««i(«(fto)+Jog(if«(i'-pAO) (8) 5 achieved by software which rearranges the positions of 

. , , , « . . pixels in accordance with the required coordinate 

Invcrtmg the log-polar map to get the Cartesian miagc ^^^^^ log-polar image image may also be gener- 

ated by conducting light from image points through an 
r^rho*siMfketa-pk(^ (9) optic fiber bimdle to photosensitive locations in a pho- 

10 tosensor chip. The individual fibers of the fiber optic 
which is the polar coordinate equation of a circle of bundle are arranged so that Cartesian image points cor- 
radius rho/2 through the origin and the apex of the respond to log-polar coordinetes at the photosensor 
Cartesian line. But this circle is the rho-theta orbit of the chip. In this manner a conventional two-dimensional 
Hough sine wave corresponding to the apex in question. array of photosensors can be employed, 
that is the set of polar coordinate solutions to the equa- Whatever the source of log-polar image data, and as 
tion (1) of Duda and Hart, rewritten as described in detail below, the input log-polar image is 

first processed by a 3x3 or other suitable geometry 
re/fto<tan(/Artfl)*coi(/AO-ci»(/Artfl)*rf/i{pAj)I (10) pixel neighborhood operator to identify high contrast 

points. This initial processing function may be elimi- 
where rho and phi are the polar coordinates of the 20 ^x^^ y j^put log-polar image is a contour image 
candidate point. These orbits intersect at the origin and such as a line drawing, blueprint, or the like. In this 
at the apex of the common line through candidate points letter case candidate points are selected by threshold 
PI and P2. rather than 3x3 filter. The output of the system 10 is 

The preceding Cartesian construction process is an found in a Hough Transform Accumulator and is iUus- 
•*in-placc" (image domain) algorithm equivalent to the 25 ^^^^^ wherein smaU dots indicate "hits" 

classical Hough transform. The circle with diameter f^om the construction process. Larger dots indicate 
through the ongm and apex of ahne may be referred to ^^j^^ ,^ corresponding to peak bins of the histo- 
as an apical-circle of tliat apex The Cartesian construe- ^ differential movement Look Up Table (LUT) 

tion above expresses the fact tnat apical circles of collm- ^^^^^ ^^^^^ construction curve (mirror imaee 

car pomts all mtcrsect at the ongin and at the apex of 30 \QtTj[]xit) 
the line of collinearity. This is an awkward computation ^* 

in Cartesian coordinates. Construction of circles re- HOUGH TRANSFORM HARDWARE (FIG. 6) 
quires quadratic computation, and discretization near . _ . rmowi'^ou^ 

The ori^n would distort the histogram. ^ .^«P"* ^^^'"^^^ ^""^ il^^ 

However, in the log-polar domain employed by the 35 stores miages data that has been mapped to a log-polar 
invention log-circles through the origin are mirror im- format either by a CPU, or by dedicated mapping hard- 
ages of log-lines, all of which are identical in scale. through Input Interface \^ (correspondmg to 
orientation, and resolution. The histogram building step 0 above). Representative mput log-polar image 
construction requires but a single one-dimensional data is shown m FIG. 5a 

lookup table, which is basically the chain code of a 40 The image data m the Array X2a is scanned for the 
log-line. No scaling is required, and there are no slope presence of edges using a 3x3 matrix of coefficients 
quantization effects. This simplification is one important that is multiplied with a 3 X 3 neighborhood of image 
point of novelty of the present invention over known data. Those familiar with the art wiU recognize that a 
Hough transform techniques and variations thereof 5x5, 7x7 or other sized neighborhood would also be 

The connection between log-polar and Hough do- 45 suitable. The 3 x 3 size was selected because it can more 
mains may be geometrically interpreted as follows. The cfTiciently be implemented in hardware. The resultant 
Hough domain is a polar coordinate representation of products are summed to generate a number that indi- 
the apexes of lines in the Cartesian domain. The Hough cat« the strength of an edge at the center of the 3 X 3 
domain sine wave is the orbit of apexes of all lines area (corresponding to step 1' above) If the edge 
through a point. Taking the log of the rfio dimension 50 strength exceeds a programmable threshold, a Hough 
convertsthesine wave to the mirror image of a log-line, transform process is initiated. This function may be 
i.e. equations (9) and (5). From the Cartesian domain, implemented with an "edge detector'* integrated circuit 
taking the log-polar mapping transforms lines into log- 1^ such as a device known as a PDSP16401 manufac- 
lincs. Thus, the log-polar domain is jfunctionally "half- tured by Plessey. An Edge Scan Address Generator 
way'* between Canesian and Hough domains. Applying 55 (ESAO) 18 generates addresses for reading out the 
the log-polar mapping to the Cartesian domain and Array 12a such that the stored array data is provided to 
iog(rho) to the Hough domain unifies their geometries. serial shift registers 20 and 22 for application to the edge 

FIG. 6 is a block diagram of a presently preferred detector 16. A Threshold Register 40 stores a predeter- 
hardware system 10 constructed in accordance with the mined threshold value for input to an Edge Level Corn- 
invention for accomplishing the log-Hough transform. 60 parator 42. Another input to comparator 42 is the out- 
The input to the system 10 is shown in FIG. Sa and is an put of edge detector 16. Comparator 42 compares a 
image presented in log-polar format. Log-polar coordi- predetermined threshold value, from threshold register 
nates arc the natural ray-ring coordinates in polar expo- 40, with the edge strength output 16ei of the edge detec- 
nential CCD sensor arrays of a type disclosed in the tor 16 If the edge strength is greater than the threshold 
proceedings of a conference presented by G. Sandini et 65 40a the edge comparator output 42^ signals Control 
al., "Retina-Like CCD Sensor for Active Vision", Logic 44 to initiate a transform operation. The Control 
NATO Advanced Research Workshop on Robots and Logic 44 generates all of the required clock signals and 
Biologiqd Systems, D Ciocco, Tuscany, Italy, June enables to operate the counters, registers and memory 
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arrays shown in FIG. 6. The Hough Transform opera- example, software and hardware can be made much 
tion writes a log-line to the output buffer, wherein inter- more efficient in that the number of pixels to be pro- 
sections arc accumulated. This aspect of the operation cessed is reduced by factors ranging from 10-to-l to 
of the system 10 is described in detail bdow. The edge 100-to-l by the reduced resolution in the peripheral 
detection function may also be implemented with cus- 5 field of view. The separate Hough domain representa- 
tom hardware, such as gate arrays or ASICs, or could tion is eliminated. Scaling, that is, multiplication by rho 
be implemented in software executed by a computer in the Hough domain, is eliminated. Expensive hard- 
such as a Digital Signal Processor (DSP). As such, the ware multipliers necessary in high performance systems 
details of circuit implementation, such ais the require- for conventional Hough transforms, such as described 
ment for shift registers 20 and 22, may change. 10 by Hanahara et al. in "A Real-Time Processor for the 
The Hough transform process increments the con- Hough Domain", IEEE Transactions on Pattern Anal- 
tents of each pixel in an Output Memory Array Hb ysis and Machine Intelligence, Vol. 10, No. 1/88, are 
along a path that is the Hough transform of the detected completely eliminated by the present invention, 
edge point. The address output from ESAG 18 is cm- The traditional Hough transform is biased in iu rec- 
ployed to load two eight bit counters, specifically a U 15 ognition of lines which align with discrete symmetries 
address counter 28 and a V address counter 30. The U of the grid. For example, in a journal article ''Natural 
counter 28 and the V counter 30 correspond to u and v Representations for Straight Lines and the Hough 
in the equations presented supra. These two counters 28 Transform on Discrete Arrays", IEEE Trans, on 
and 30 generate an address for the 128x 128 byte Out- PAMI, Vol. 1 1, pp. 941-950, Sept. 1989 1. D. Svalbe has 
put Memory Array 126 during the transform process. 20 characterized the degree of bias as a "vote surface** 
The data path is followed by controlling the movement which may be used to compensate the histogram by 
of the U and V address counters 28 and 30. A Trans- weighting. As such, this technique adds an extra level of 
form Path Counter 34 is initialized to zero and counts storage and processing. In contradistinction, in the log- 
up, 1 count per clock cycle, until the required number Hough transform employed by the invention the vote 
of transform path points, 255 maTiTnnm for this imple- 25 surface is uniform. There is no slope discretization prob- 
mentation, are counted. The output of Counter 34 is lem because the log-polar mapping rotationally synrnie- 
employed to address a 256x4 bit Differential Move- trizes the image. 

ment LookUp Table (DM_LUT) 36. The 4 bit DM— In the aforementioned journal article by Duda and 

LUT 36 output 36a controls the U and V address count- Hart there is suggested, and in a journal article by D. H. 

ers 28 and 30 to either hold, increment or decrement. 30 Ballard entitled "Generalizing the Hough Transform to 

If the U"V address generated by counters 28 and 30 is Detect Arbitrary Shapes", Pattern Recognition, Vol. 
within the Output Memory Array Ub address space, as 13, pp. 1 1 1-122, 1981, there are defined generalizations 
detected by the valid ADDR detector 50, the corre- of Hough methods to other families of curves. From the 
sponding content of the Array 32 is read, incremented construction in FIGS. 3 and 4, the mirror duality be- 
by 1 by ALU 38, and written back to the same location 35 tween circles through the origin and straight Unes gives 
within Array 12^ (corresponding to steps 2' and 3' an immediate recognition rule for the former: simply 
above). It should be noted that the Output Memory substitute log-lines for their mirror images in steps 2' 
Array 12* is cleared, typically by a Host CPU (not and 4Mn the aforementioned journal article by Chaikin 
shown), before the transform operation is initiated. and Weiman it is shown that the log-polar mapping of 

Step 4' above may be realized by reading out the 40 other conic sections, namely parabolas and hyperbolas, 

contents of the buffer 12* through the Output Interface are simply log-line^ scaled by 2 and i. Thus their recog- 

14* to determine bins having maximum values, these nition follows similar steps. 

bins corresponding to the apexes of recognized log- More generally, the recognition of geometric entities 

Ijjies, which are scaled and rotated is simplified by the log- 

Although the input and output memory arrays tla 45 Hough transform employed by the invention. One as- 
and 12* are shown as separate buffers, it is instructive to pect of significance of the log-Hough transform is that it 
view them as a common memory element with input enables realtime VLSI implementations which arc com- 
and output data contained in upper and lower data pletely impractical in the Cartesian version. The "in- 
bytes. This aids in visualizing the results of the accumu- place" nature of the log-Hough algorithm makes it 
lation of data (intersections) in the output buffer. That 50 possible to apply local pixel neighborhood processing 
is, the address ofthc peak values in the output buffer 12* such as that suggested by Carver Mead*s **silicon re- 
is also the address of the apex of a corresponding line in tina", as described in "Analog VLSI and Neural Sys- 
the input buffer 12a That is, both buffers express corre- tems", Addison-Wesley, 1989. The use of the invention 
sponding log-polar data and no translation between beneficially eliminates the need for buses to export data 
coordinate domains is required, as is the case with con- 55 off-retina to an external Hough domain, 
vcntional methods. The VLSI approach suggested above is analogous to 

With a 15 MHz clock source (CLK) a full edge scan the direction-field solutions of differential equations, 

of the Log-Polar Image for edges requires less than one The candidate point serves as the initial condition; the 

millisecond. If i of the pixels (8192/4«2048) result in a paths of enabled excitation are the graphical solution, 

detected edge, an additional 9 milliseconds is required 60 Since log-line templates require no scaling throughout 

to complete the 2048 Hough transform paths, if each is the log-polar domain, nearest neighbor connection pat- 

64 pixels in length. terns can be identically replicated throughout the pixel 

It may be surprising to discover that log-polar map- array. A traditional Hough domain array would have 

ping, which destroys the straighiness of lines, is better no such architectural stability. ScaUng of the sine curve 

suited for the Hough transform recognition of straight 65 by the factor rho can occur arbitrarily anywhere in the 

lines than Cartesian coordinates. As such, the signifi- Hough domain. Direction fields for classical Cartesian 

cance of the teaching of the invention for image pro- Hough transfonns must be capable of dynamic scaling 

cessing includes a number of important aspects. By on a global basis. 
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The "in-place" and scale invariant template proper- 
ties of the log-Hough transform may well have signifi- 
cance for the neurophysiological architecture of human 
vision. The eye-brain (rctino-topic) mapping known to 
be log-polar except for the small fovcal region in the 5 
center of the field of view. WeU known gestalt comple- 
tion phenomena of perception include the ability to see 
straight lines in the presence of clutter and obscuration. 
The "in-place" property of the log-Hough transform 
enables pattern processing at the site of iconic represen- 10 
tation rather than at a separate brain domain. The repli- 
cated patterns of ocular dominance columns in the vi- 
sual cortex are ideally arranged for the direction field 
solution of log-line templates. The regular arrangement 
of cdge^Ietector orientations with each column is pre- 13 
cisely that which would be required for directionally 
selective excitation of nearest neighbors (direction 
field). 

FIG. 7fl is a flowchart that illustrates the various 
steps of the method of the invention. FIO. lb illustrates 20 
m greater detail the steps of the block "Construct Pea- 
tures of Interest" of FIG. 7a. 

FIG. %a illustrates an original image presented in the 
Cartesian domain, FIO. 8Zr illustrates the image after a 
transformation to the Log-polar domain and, in accor- 25 
dance with the invention, FIG. 8c illustrates the image 
transformed to the Log-Hough domain. In FIG. 8c the 
bright bins correspond to locations of apexes of log- 
lines in FIG. 8^, which is the desired result. 

Appendix A is a C program listing that accomplishes 30 
the method of the invention. This program express^ 
steps r through 4' in software and operates on arrays of 
data in an image frame store, which is accessed by func- 
tions "rpixelQ" and "wpixel 0"- 

Line 3 of the program defines two arrays, *pD' and 35 
*q[]\ which contain the pixel coordinates of points on a 
mirror image of a log-line. Line 4 is the beginning of the 
main program. Lines 6 and 7 show variables. Variables 
*p* and *q* arc coordinate locations m the log-polar 
image shown in FIG. 5a. 'Histogram—offset' is the on- 40 
gin of the Hough Transform Accumulator in video 
memory. *Max— sum*, *max_p— address' and *max- 
_q_^dress' are used to find the peak in the Hough 
Transform Accumulator. Lines 10 and 1 1 are the size of 
the log-polar image. Line 14 is the first step in the pro- 45 
gram, it calls *make_templateO' which creates the *p[]*, 
•qQ* offset points for the mirror image of a log-line. Line 
17 is the grey level thr«hold which points must exceed 
to be considered candidate points for the Hough trans- 
form, lines 20 and 21 are the loops which cause the 50 
program to consider every point p,q in the log-polar 
image. Line 25 reads the grey level value of each pixel 
using the function *rpixelO*. If the pixel's grey value is 
above the threshold, then it is considered a candidate 
point, otherwise the loop continues. Line 26 is a loop 55 
which causes the Hough transform accumulator to be 
incremented for every point on the mirror image log- 
line associated with the candidate point. Line 34 reads 
the previous Histogram bin level from video memory 
using *rpixelO*f line 35 increments the histogram bin, 60 
line 37 write the new values back into the Hough Trans- 
form Accumulator using the function SvpixelO'- Lines 
41-44 compare the present histogram level with the 
maximum value detected thus far. Also, these lines store 
the p,q location of the max value. Line 53 is *make^tem- 65 
platcQ* which calculates the p,q offsets of the mirror 
image of a log-line. Line 62 is a loop which causes the 
program to calculate the offset points for the 180 de- 



,604 

12 

grees of a line. Line 64 is the negative of equation (5) in 
the preceding description. Lines 66 and 67 indicate 
where the relative offset points of the mirror image of a 
log-line are calculated and stored. Step 5', not shown, 
simply include? additional steps of writing into the 
firame buffer at locations which are offset from the peak 
binbypM. -q[k]. 

In this regard it can be appreciated that after the 
histogram is accumulated in the output buffer 12b of 
FIG. 6 that the circuitry can be redirected by multiplex- 
ers and the like to provide the output of the buffer 12^ 
to a threshold detector or similar circuitry for con- 
structing the features of interest (corresponding to step 
5' above) which were detected in the log-Hough pro- 
cess. In so far as the Differential Movement LUT 36 
holds the mirror-image of a log-line, the log-line itself 
can be generated by incrementing the U Address 
Counter 28 when the Differential Movement LUT 36 
entry, as expressed on output lines 36a, requests decre- 
menting the Counter 28. This effective reversal of sign 
along the x-axis can be achieved by the Control Logic 
44 which is in a Feature Construction State as opposed 
to a Feature Recognition State. That is, the construc- 
tion of a log-line is the mirror image of the construction 
of the Hougih transform. In this further embodiment of 
the invention the Differential Movement LUT 36 is 
employed to reverse the sign of the x coordinates. The 
feature(s) may be constructed within a third buffer 
memory (not shown) or directed to the input buffer 
memory 12a to be superimposed upon the original log- 
polar image. In this manner the invention provides both 
the recognition of significant extended features and the 
construction of idealized representations of the recog- 
nized features in-placc on the input image. 

As can be realized, the teaching of the invention may 
be practiced in a number of different software and hard- 
ware embodiments and is not to be construed to be 
limited to any one particular embodiment. Thus, while 
the invention has been particularly, shown and de- 
scribed with respect to presently preferred embodi- 
ments thcrcbf it will be understood by those skilled in 
the art that changes in form and details may be made 
therein without departing from the scope and spirit of 
the invention. 

APPENDIX A 

Copyright 1989. Transitions Research Corporation. 

/• Program to pcrfonn log-polar Hough transformation •/ 
int p[64],q[6i]; /* storage for mirror log-line template •/ 
main( ) 
{ 

int i, sum. thresh. hUtogram_onset; 

int p, q, max-som, max^p— address, max..qwaddress; 

/♦ size of log iouge ♦/ 

mtxp n= 128; 

maxq ^ 52; 

/* make template for mirror image of a log line */ 
make_template( ); 

/* detection threshold for a line in log image */ 
thresh = 70; 

/" for every point in log inuge see if it is on a line */ 
for(p=0;p<maxp;p+ + ) { 

for(q=;q<maxq;q++) { 

/• STEP 1' •/ 

/• if point is above threshold it is a candidate point •/ 
ifi[ rpUel(q,p) > thresh) { 
/• STEP 2' •/ 

/• for each candidate point, overlay the template */ 
for<i=0ii<64;i++>{ 

/• STEP y V 

/* build the output histogram in video memory */ 
/* read old value */ 

sum « rpixel(q+q[i] + histograni_ofrset. 
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Copyright 1989, Transitions Research Corporation 

p+ptil-iiiaxp/4); 
tam++; 

/* write new value •/ 

wpixel(q — qp] + histograixi.ofrset,p + p HI — aujip/4,suiD); 
n STEP 4' V 

/* store position of peak of histogram*/ 
if(sum > max—sum) { 
ttf « , p ftddrffy " p; 

ddress » q+hi$togram_ofCset; 
: sum; 



} 



} 



} 



15 



20 



25 



} 

/* make template for mirror image of poist*s apical log-line */ 
make;_tempUle< ) 

double a, v. n, pi; 
intk; 

pi = 3.1415926; 
n = 128.; 

/• find coordiaies of points on a mirror image of log line •/ 
for(k=I;k<Cmt)n/2;k++) { 

V = pi/{nya.)'(float)k; 

u « log($in(v)); 

/• offset points of line V 

pM « (intXn/(2.»pi)«v); 

q(k) = (intKii/(2.*pi)*u): 

} 

30 

What is claimed is: 

1. A method of processing image data to detect the 
presence of an extended feature or features of interest 
therein, the method comprising the steps of: 

providing an image represented in a logarithmic polar 35 
(log-polar) coordinate system; 

selecting image points which are candidates for mem- 
bership in the feature of interest; 

for each selected image point, constructing a curve in 
the same logarithmic polar coordinate system as 40 
the image, the curve characterizing the locus of 
possible locations of the feature of interest consis- 
tent with the selected image point; 

accumulating a histogram whose bins coincide with 
points in the same logarithmic polar coordinate 43 
system as the image, which bins contain counts of 
the number of constructed curves intersecting at 
the location of the bin; and 

selecting bins having greatest counts as representing 
the locations of definitive points for characterizing 50 
the location of the extended feature of interest 
within the image. 

2. A method as set forth in claim 1 and including an 



7. A method as set forth in claim 6 wherein the step of 
constructing a curve constructs a curve that is a mirror 
image of a curve in logarithmic polar coordinates that 
the corresponds to a circle through the origin of the 

5 log-polar coordinate system. 

8. A method as set forth in claim 3 where the curves 
are parabolas or hyperbolas whose focuses are at the 
origin of the log-polar coordinate system. 

9. A method as set forth in claim 1 wherein the step of 
10 providing ar image includes a step of capturing an 

image with a polar exponential sensor array. 

10. A method as set forth in claim 1 wherein the step 
of providing an image includes a step of mapping Carte- 
sian image coordinates to log-polar coordinates by 
usmg a hardware address lookup table and an accumu- 
lator memory. 

11. A method as set forth in claim 1 wherein the step 
of providing an image includes a step of conducting 
light from image points through an optic fiber bundle to 
photosensitive locations in a photosensor chip. 

12. A method as set forth in claim 1 wherein the step 
of selecting image points includes a step of applying a 
function whose domain is a local neighborhood of a 
candidate pixel, the process of selection being deter- 
mined by the value of the function. 

13. A method as set forth in claim 6 wherein the step 
of constructing a curve includes a step of incrementing 
the contents of a memory array whose elements are 
addressed by an address generated by the curve con- 
struction process. 

14. A method as set forth in claim 1 wherein the step 
of constructing a curve includes a step of incrementing 
an array variable in a software program, which variable 
is specified by the curve construction process. 

15. Image processmg apparatus for detecting the 
presence of a feature of interest within an image com- 
prising: 

means for providing image data in a log-polar format; 
means for selecting candidate, points within the image 
data; 

means for constructing, for every candidate point, a 

mirror image of the point's apical log-line; 
means, coupled to the means for constructing, for 

storing values in bins of a histogram; and 
means for selecting a bin of the histogram having a 
peak value, the position of the selected bin corre- 
sponding to a position of the feature of interest 
within the image. 

16. Image processing apparatus as set forth in claim 
15 wherein the means for selecting candidate points 
within the image includes means for performing an edge 
detection operation on the image data. 

17. Image processing apparatus as set forth in claim 



additional step of: 

constructing the detected features by marking points 55 16 wherein the means for performing edge detection 



in the image, using the locations of the peak bins as 
a reference point for the construction. 

3. A method as set forth in claim 1 where the ex- 
tended features of interest are curves, including lines. 

4. A method as set forth in claim 3 where the curves 60 
are strai^t lines. 

5. A method as set forth in daim 4 wherein the step of 
constructing a curve constructs a curve that is a mirror 
image of a curve in logarithmic polar coordinates that 
corresponds to a straight line, 

6. A method as set forth in claim 3 where the curves 
arc circles through the origin of the log-polar coordi- 
nate system. 



includes: 

means for applying an nXm pixel neighborhood op- 
erator to the image data; and means for detecting 
the presence of image pixels having a value equal to 
or greater than a predetermined threshold value. 
18. A method of processing a set of multi-dimensional 
data elements so as to detect an extended feature or 
features of interest, each feature being comprised of a 
plurality of the multi-dimensional data elements, com- 
65 prismg the steps of: 

providing a representation of the multi-dimensional 
data elements in a logarithmic-polar coordinate 
system; 
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selecting multi-dimensional data elements that are 
candidates for membership in the feature of inter- 
est; 

for each selected multi-dimensional data element, 
constructing a curve in the same logarithmic-polar 5 
coordinate system as that in which the multi- 
dimensional data element is represented, the curve 
characterizing a locus of possible locations of the 
feature of interest, consistent with the selected 
multi-dimensional data element; 10 

accumulating a histogram having bins that coincide 
with points int the same logarithmic-polar coordi- 
nate system as the representation of the multi- 
dimensional data elements* which bins contain 
counts of the number of constructed curves inter- 15 
secting at the location of the bin; and 

selecting bins having greatest counts as representing 
parameters that characterize the extended feature 
or features of interest. 

19. A method as set forth in claim 18 wherein the step 20 
of providing a representation of the multi-dimensional 
data elements in log-polar format includes a step of 
viewing an environment with an image sensor array 
means constructed to generate image data in log-polar 
format. 23 

20. A method as set forth in claim 19 wherein the 
method of processing a set of multi-dimensional ele- 
ments is accomplished locally within the image sensor 
array means. 

21. A method as set forth in claim 19 wherein the 30 
feature of interest is selected from the group consisting 
of straight Unes, curved lines, conic sections and combi- 
nations thereof. 

22. A method as set forth in claim 18 wherein the step 
of providing includes a step of mapping non-log-polar 33 
coordinates to log-polar coordinates using a look-up 
table means. 

23. A method as set forth in claim 18 wherein the step 
of selecting multi-dimensional data elements includes a 



step of applying a function whose domain is a local 
neighborhood of a multi-dimensional data element, the 
process of selecting being determined by the value of 
the function. 

24. Apparatus for processing a set of multi-dimen- 
sional data elements so as to detect an extended feature 
or features of interest, each feature being comprised of 
a plurality of the multi-dimensional data elements, com- 
prising: 

means for providing a representation of the multi- 
dimensional data elements in a logarithmic-polar 
coordinate system; 

means for selecting multi-dimensional data elements 
that arc candidates for membership in the feature of 
interest; 

means for constructing, for each selected multi- 
dimensional data element, a curve in the same loga- 
rithmic-polar coordinate system as that in which 
the multi-dimensional data element is represented, 
the curve being constructed so as to characterize a 
locus of possible locations of the feature of interest, 
consistent with the selected multi-dimensional data 
element; 

means for accumulating a histogram having bins that 
coincide with points in the same logarithmic-polar 
coordinate system as the representation of the mul- 
ti-dimensional data elements, which bins contain 
counts of the number of constructed curves inter- 
secting at the location of the bin; and 

means for selecting bins having greatest counts as 
representing parameters that characterize the ex- 
tended feature or features of interest. 

25. Apparatus as set forth in claim 24 wherein the 
means for providing the multi-dimensional data ele- 
ments in the log-polar format includes image sensor 
means constructed to generate image data in the log- 
polar format. 
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